REMARKS 

In view of the above amendments and the following remarks, reconsideration of the 
rejections and further examination are requested. 

Claims 1-11 were pending in this application. Claims 1,3,4 and 6-11 stand rejected. 
Claims 2 and 5 have been indicated as containing allowable subject matter. Claims 2, 3 and 5-11 
are amended herein, and claims 1 and 4 are cancelled herein. Thus, claims 2, 3 and 5-11 are 
currently pending in this application. No new matter has been added. 

The specification and abstract have been carefully reviewed and revised to make 
grammatical and idiomatic improvements in order to aid the Examiner in further consideration of 
the application. A substitute specification and abstract including the revisions have been 
prepared and are submitted herewith. No new matter has been added. Also submitted herewith 
are marked-up copies of the substitute specification and abstract indicating the changes 
incorporated therein. 

The Applicant greatly appreciates the Examiner's indication that claims 2 and 5 contain 
allowable subject matter and would be allowable if rewritten in independent form including all 
of the limitations of the base claim and any intervening claims. In view of this indication, claim 
2 has been amended to be an independent claim including the subject matter of previously 
pending claim 1 (that is, the independent claim from which it depended), and claim 5 has been 
amended to be an independent claim including the subject matter of previously pending claim 4 
(that is, the independent claim from which it depended). Moreover, independent claims 6 and 7 
have been amended to include the allowable subject matter of claims 2 and 5, respectively. 

Claims 1, 3 and 4 have been rejected under 35 U.S.C. § 102(e) as being anticipated by De 
Haan et al. (U.S. Patent Application Publication No. 2006/0055829) (hereinafter referred to as 
"De Haan"). Claims 6-11 have been rejected under 35 U.S.C. § 103(a) as being unpatentable 
over De Haan in view of Kuwata et al. (U.S. Patent Application Publication No. 2002/0044122) 
(hereinafter referred to as "De Haan"). Claims 1 and 3 have been rejected under 35 U.S.C. § 
102(b) as being anticipated by Koyama (U.S. Patent Application Publication No. 2002/0180677) 
(hereinafter referred to as Koyama"). 
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By virtue of cancelling claims 1 and 4, and amending claims 2 and 5-7 as described 
above, the Applicant respectfully submits that the 35 U.S.C. § 102(e), 35 U.S.C. § 103(a) and 35 
U.S.C. § 102(b) rejections of these claims have been rendered moot. 

Accordingly, the Applicant respectfully requests that the prior art rejections of these 
claims be withdrawn. 

In view of the foregoing amendments and remarks, all of the claims now active in this 
application are believed to be in condition for allowance. Reconsideration and favorable action 
are respectfully solicited. 

Should the Examiner believe there are any remaining issues that must be resolved before 
this application can be passed to issue, it is respectfully requested that the Examiner contact the 
undersigned by telephone in order to resolve such issues. 

Respectfully submitted, 

Kazuhiro YAMADA 

/Kevin McDermott/ 
u 2008.05.28 1 6:48:06 -04'00' 

Kevin McDermott 
Registration No. 48,113 
Attorney for Applicants 

KM/JRF/km 

Washington, D.C. 20006-1021 
Telephone (202) 721-8200 
Facsimile (202) 721-8250 
May 28, 2008 
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VERSION WITH MARKINGS TO 
SHOW CHANGES MADE 



DESCRIPTION 

METHOD AND UNIT FOR PROCESSING IMAGE SIGNAL AND 

IMAGE DISPLAY DEVICE 

5 

TECHNICAL FIELD BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image signal processing 
method and unit for performing nonlinear compensation on image 
10 signals, and to an image display device using the method and unit. 

BACKGROUND ART 2. Description of the Related Art 

Human visual characteristics are nonlinear. In particular, the 
degree of brightness human beings feel has characteristics of a 

15 logarithmic function with respect to luminance, as shown in Fig. 5. 
In a cathode ray tube (CRT), the display luminance with respect to an 
image signal has so-called gamma characteristics, as shown in Fig. 6A. 
Thus, in a display device using CRTs, the gamma characteristics and 
visual characteristics of a logarithmic function cancel out each other 

20 and the degree of brightness human beings feel has characteristics 
substantially linear with respect to image signals. 

In contrast, newly-developed display devices, such as a digital 
mirror device (DMD) and plasma display panel (PDP), do not have the 
gamma characteristics. As shown in Fig. 6B, these display devices 

25 have characteristics in which the display luminance is linear with 
respect to image signals. Therefore, in these display devices, the 
degree of brightness human beings feel exhibits characteristics of a 
logarithmic function with respect to image signals. For this reason, 
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to compensate the degree of brightness of image signals human beings 
feel to have linear characteristics, nonlinear compensation must be 
performed on the image signals. Proposed as one of the methods is 
using a look-up table (hereinafter abbreviated as "LUT") to perform 
5 nonlinear compensation, as shown in Fig. 7 (see Japanese Patent 
Unexamined Publication H10153983, for example). 

Fig. 8 is a table showing an example of input-output 
characteristics in such a LUT. In this table, "input gradation" is an 
image signal before compensation, and the signal levels of the image 

10 signals to be fed into the LUT are expressed in 256 steps, i.e. "0" to 
"255". "Display gradation" is an image signal after compensation, 
and the signal levels supplied from the LUT are standardized so that 
the maximum value thereof is "255". In Fig. 8, the display gradations 
are shown only when the input gradations are "0", "10", "20", and so on, 

15 to "250". 

When a display device is installed in a dark place, and no 
ambient light incident on the display device, nonlinear compensation 
is performed on the input gradations to be fed into a display device 
having no gamma characteristics, such as a PDP, as shown in Fig. 8. 
20 Then, the relation between the input gradation and display luminance 
exhibits gamma characteristics, as shown by characteristic curve A in 
Fig. 9A. Thus, the degree of brightness human beings feel and input 
gradations are substantially linear, as shown by characteristics curve 
B in Fig. 9B. 

25 However, when the display device is installed in a bright place, 

the display luminance is uniformly increased by the influence of 
ambient light, as shown by characteristic curve C in Fig. 9A. Thus, 
even the conventional nonlinear compensation cannot return the 



3 



degree of brightness human beings feel so as to have linear 
characteristics. Characteristic curve D in Fig. 9B shows the degree of 
brightness human beings feel with respect to the input gradations at 
that time. Human beings cannot recognize a change in gradation 
5 clearly in the portion of low input gradations. 

This phenomenon depends on the human visual characteristics 
and can be considered as follows. Assume that the display gradations 
shown in Fig. 8 indicate the display luminance in a dark place. Then, 
when the input gradation increases from 10 gradations to 20 

10 gradations, the display luminance increases "0.2" to "0.9", thus making 
human beings feel that the brightness is 4.5 times. In contrast, 
assume the display luminance increases by a luminance corresponding 
to "30", for example, in a bright place, under the influence of ambient 
light incident to the display device. In this case, even when the input 

15 gradation increases from 10 gradations to 20 gradations, the display 
luminance increases from "30.2" to "30.9" only. Thus, human beings 
almost cannot feel a change in brightness. Of course, for a brighter 
image, the ratio of the display luminance between 240 gradations and 
250 gradations in a dark place, for example, is 244.1/223.2 = 1.09. 

20 The ratio between the same gradations in a bright place is 274.1/253.2 
= 1.08. These figures do not have a large difference and thus the 
influence of ambient light is negligible. 

As described above, for the conventional method of nonlinear 
compensation, because a display device is influenced by the ambient 

25 light incident thereon, the degree of brightness human beings feel 
cannot be compensated to have linear characteristics. Particularly in 
a dark image having low input gradations, a change in gradation 
cannot be recognized and the gradations become uniform. 
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The present invention addresses this problem and aims to 
provide an image signal processing method and unit capable of 
compensating the characteristics of brightness of image signals human 
beings feel, even when the display luminance of a display device has 
5 characteristics linear with respect to the image signals and the display 
luminance is uniformly increased by the influence of ambient light 
incident to the display device. The present invention also aims to 
provide an image display using the method and unit. 

10 SUMMARY OF THE INVENTION 

The present invention provides an image signal processing 
method for performing nonlinear compensation on image signals to be 
fed into a display device. According to the brightness of the place in 
which the display device is installed, the characteristics of nonlinear 
15 compensation are changed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a circuit block diagram of an image display device in 
accordance with a first exemplary embodiment of the present 
20 invention. 

Fig. 2A is a graph showing a relation between an input 
gradation and display luminance in an image signal compensation 
method in accordance with the first exemplary embodiment. 

Fig. 2B is a graph showing a relation between an input 
25 gradation and a degree of brightness human beings feel. 

Fig. 3 is a circuit block diagram of another image display device 
in accordance with the first exemplary embodiment. 

Fig. 4 is a circuit block diagram of an image display device in 
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accordance with a second exemplary embodiment. 

Fig. 5 is a graph showing a degree of brightness human beings 
feel with respect to luminance. 

Fig. 6A is a graph showing a relation between an image signal 
5 and display luminance in a cathode ray tube (CRT). 

Fig. 6B is a graph showing a relation between an image signal 
and display luminance in a digital mirror device (DMD) and plasma 
display panel (PDP). 

Fig. 7 is a circuit block diagram of a conventional image display 
10 device. 

Fig. 8 is a table showing an example of input-output 
characteristics in a look-up table. 

Fig. 9A is a graph showing a relation between an input 
gradation and display luminance in a conventional image signal 
15 compensation method. 

Fig. 9B is a graph showing a relation between an input 
gradation and a degree of brightness human beings feel. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS THE 
20 INVENTION 

Exemplary embodiments of the present invention are 
hereinafter demonstrated with reference to the accompanying 
drawings. 

25 FIRST EXEMPLARY EMBODIMNT 

Fig. 1 is a circuit block diagram of image display device 100 in 
accordance with the a first exemplary embodiment of the present 
invention. Image signal processing unit 101 performs nonlinear 
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compensation on an input image signal, i.e. input gradation, and 
outputs a signal to display device 103. Display device 103 is a display 
device having no gamma characteristics, such as a digital mirror 
device (DMD) and plasma display panel (PDP). Image signal 
5 processing unit 101 includes ambient light detector 104 for detecting 
the brightness of ambient light, and compensator 105 for performing 
nonlinear compensation on the input gradation according to the 
brightness of the ambient light. 

Ambient light detector 104 includes optical sensor 106 for 

10 sensing the brightness of ambient light, and analog-to-digital (A/D) 
converter 107 for converting a signal sensed by optical sensor 106 to a 
digital signal. Compensator 105 includes a plurality of look-up tables 
(LUTs) 108i to IO84 used for nonlinear compensation on the input 
gradation, and LUT selector 112 for selecting one LUT from among the 

15 plurality of LUTs IO81 to IO84, according to the signal detected by 
ambient light detector 104. Fig. 1 illustrates four LUTs IO81 to IO84; 
however, of course, the number of LUTs is not limited to four. An 
arbitrary number of LUTs can be used as required. Generally, an 
increased number of LUTs can accommodate a wider range of ambient 

20 light and set a change in display luminance caused by switching the 
LUTs smaller. 

Each of the plurality of LUTs IO81 to IO84 performs nonlinear 
compensation on the input gradation according to the following 
equation: 

25 (Display gradation) = K x (input gradation) 7 

Now, gamma factor y is a value larger than 1, which is set to a 
different value for each of the LUTs. Coefficient K is a coefficient for 
making the maximum value of the display gradation equal to the 
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maximum value of the input gradation, and is expressed by the 
following equation: 

K = (maximum value of input gradation) (1 " r) 

In this embodiment, LUT 108i is a LUT for nonlinear 
5 compensation in a dark place without ambient light. In this LUT, 
gamma factor y is set to 2.2. When nonlinear compensation is 
performed on an input gradation using LUT IO81 in a dark place for 
image display, the relation between the input gradation and display 
luminance is as shown by characteristic curve A in Fig. 2A. The 

10 degree of brightness human beings feel exhibits characteristics 
substantially linear with respect to an input gradation, as shown in 
characteristic curve B in Fig. 2B. When nonlinear compensation is 
performed on an input gradation using LUT IO81 for a dark place with 
the display luminance uniformly increased by the influence of ambient 

15 light as shown by characteristic curve C in Fig. 2A, the linearity of the 
brightness human beings feel is affected, as shown by characteristic 
curve D in Fig. 2B, and gradations become uniform in the part of low 
input gradations. Therefore, in this case, nonlinear compensation is 
performed using LUT IO84 having a small gamma factor y, as shown by 

20 characteristic curve E in Fig. 2A. Then, the degree of brightness 
human beings feel can be compensated so as to substantially be linear 
with respect to an input gradation, as shown by characteristic curve F 
in Fig. 2B. 

In this embodiment, gamma factors y of four LUTs IO81 to IO84 
25 are set to 2.2, 2.1, 2.0, and 1.9, respectively. Based on the detection 
results of ambient light detector 104, these LUTs are switched. 
However, if the characteristics of nonlinear compensation performed 
on an input gradation can be changed according to ambient light, 
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another structure can also be used. For example, the function of the 
plurality of look-up tables and look-up table selector can be achieved 
by using a processor, such as a digital signal processor. An image 
signal processing unit can also be structured by using processor 200 as 
5 compensator 205 to input an image signal and detected signal of 
ambient light and output a display gradation. This structure can 
form a compensator with a smaller number of circuit components. 

In this embodiment, the characteristics of nonlinear 
compensation are changed by changing the value of gamma factor y. 

10 However, the characteristics of nonlinear compensation can be 
changed by other methods. For example, the characteristics of 
nonlinear compensation can be obtained by measuring the 
compensation characteristics such that the brightness human beings 
feel under influence of various kinds of ambient light is linear with 

15 respect to an image signal before compensation. Thus, even in a 
display device of which display luminance has any characteristics with 
respect to an image signal, the compensation characteristics such that 
the brightness human beings feel is linear with respect to an image 
signal before compensation can be obtained. 

20 

SECOND EXEMPLARY EMBODIMENT 

Fig. 4 is a circuit block diagram of image display device 300 in 
accordance with the second exemplary embodiment of the present 
invention. The same elements of the circuit block of the first 
25 exemplary embodiment are denoted with the same reference marks, 
and descriptions thereof are omitted. The second exemplary 
embodiment differs from the first exemplary embodiment in that the 
characteristics of nonlinear compensation are changed not only 
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according to ambient light but also to the display modes of display 
device 103. For example, in a display device using a PDP, the number 
of gradations it can display (hereinafter referred to as "gradation 
display capability") conflicts with the maximum luminance it can 
5 display, because of its driving principle. Then, as the display modes 
of display device 103, dynamic mode" " dynamic mode" , "standard mode", 
"cinema mode", and the like are provided, so that a user can select a 
desired display mode. Now, in "dynamic mode", the gradation display 
capability is substantially given up to increase the maximum 

10 luminance. In "cinema mode", the maximum luminance is inhibited 
to increase the gradation display capability. "Standard mode" is an 
intermediate display mode between them. 

As described above, the brightness human beings feel is 
influenced by ambient light. However, of course, the brightness is 

15 influenced directly by the luminance of a display device. For this 
reason, to make the brightness human beings feel linear with respect 
to an input gradation, the characteristics of nonlinear compensation 
should be changed not only according to ambient light but also to the 
maximum luminance a display device displays. 

20 Compensator 305 includes a plurality of LUTs 108i to IO812 

used for performing nonlinear compensation on an input gradation, 
and LUT selector 312 for selecting one LUT from among the plurality 
of LUTs IO81 to IO812 according to a signal detected by ambient light 
detector 104 and a display mode signal supplied from display device 

25 103. Fig. 4 illustrates a structure having four LUTs for each display 
mode, 12 LUTs in total. Of course, an arbitrary number of LUTs can 
be provided as required. 

In the same display mode, as ambient light incroaGo increases , 
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the LUT is switched to one having a smaller gamma factor y. When 
the ambient light is the same, a LUT having a larger gamma factor y 
is used in "dynamic mode". In "cinema mode", a LUT having a 
smaller gamma factor y is used. 
5 By changing the characteristics of nonlinear compensation 

depending on not only ambient light but also on the display modes of a 
display device as described above, the brightness human beings feel 
can be compensated so as to substantially be linear with respect to an 
input gradation, even when a user switches the display mode to 

10 change the maximum luminance of the display device. 

In the second exemplary embodiment, as a signal indicating the 
maximum luminance display device 103 displays, a display mode 
signal supplied from the display device is used. However, any other 
signal that indicates the maximum luminance the display device 

15 displays can be used. For example, the average picture level (APL) of 
an image signal before compensation can be used. Additionally, as 
signals indicating the maximum luminance of the display device, both 
of a signal indicating the display mode and the APL of an image signal 
can be used. 

20 Also in the second exemplary embodiment, a plurality of LUTs 

is switched as compensator 305. However, any another structure for 
changing the characteristics of nonlinear compensation can be used. 
For example, compensator 305 can be structured by using a processor, 
such as a digital signal processor, to input an image signal, a detected 

25 signal of ambient light, and a signal indicating the maximum 
luminance and output a display gradation. 

Also in the second exemplary embodiment, the characteristics of 
nonlinear compensation are changed by switching a plurality of LUTs, 
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each having a different gamma factor y. However, the characteristics 
of nonlinear compensation can be obtained by measuring the 
compensation characteristics such that the brightness human beings 
feel under influence of various kinds of ambient light and the 
5 maximum luminance of the display device is linear with respect to an 
input gradation. 

The present invention can provide a method and unit for 
processing an image signal that can make the characteristics of 
brightness human beings feel linear with respect to an image signal, 
10 even when the display luminance of the display device is uniformly 
increased by the influence of ambient light. The present invention 
can also provide an image display device using the method and unit. 



INDUSTRIAL APPLICABILITY 

15 A method and unit for processing an image signal, and an image 
display device of the present invention can make the characteristics of 
brightness of human beings feel linear with respect to an image signal, 
even when the display luminance of the display device is uniformly 
increased by the influence of ambient light. Thus, the present 

20 invention is useful as an image display device or the like for 
performing nonlinear compensation on image signals. 
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ABSTRACT 

An image signal processing method for performing nonlinear 
compensation on an image signal to be fed into a display device (103). 
The characteristics of nonlinear compensation are changed according 
5 to the brightness of a place in which the display device (103) is 
installed. This method can make the characteristics of brightness of 
human beings feel linear with respect to an image signal, even when 
the display luminance of the display device (103) is uniformly 
increased by the influence of ambient light. 



